TITLE OF THE INVENTION 

DISPLAY APPARATUS, METHOD AND PROGRAM 

BACKGROUND OF THE INVENTION 
5 (1) Field of the Invention 

The present invention relates to a technology for 
displaying high-quality images on a display device which includes 
a plurality of pixels each of which is an alignment of three 
luminous elements for three primary colors. 

10 

(2) Description of the Related Art 

Among various types of display apparatuses, there are some 
types, such as LCD (Liquid Crystal Display ) or PDP (Plasma Display 
Panel) , that include a display device having a plurality of pixels 
15 each of which is an alignment of three luminous elements for 
three primary colors R, G and B (red, green and blue) , where 
the pixels are aligned to form a plurality of lines, and the 
luminous elements are called sub-pixels. 

In general, images are displayed in units of pixels. 
20 However, when images are displayed in units of pixels on a 
small-sized, low-resolution screen of, for example, a mobile 
telephone or a mobile computer, oblique lines in characters, 
photographs or complicated drawings look shaggy. 

Technologies for displaying images in units of sub-pixels 
25 with the intention of solving the above problem are disclosed 
in (a) a research paper "Sub-Pixel Font Rendering Technology" 
(hereinafter referred to as a non-patent document 1) published 
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in the address " http: //grc. com/cleartype.htm ^ in the Internet 
and (b) WO 00/42762 (hereinafter referred to as a patent document 
1) - 

When images are displayed in units of sub-pixels, with 
5 three sub-pixels for primary colors aligned in each pixel in 
the lengthwise direction of the lines of pixels (hereinafter 
referred to as a first direction) , a pixel having a color greatly 
different from adjacent pixels in the first direction (that is, 
a pixel at an edge of an image) causes a color drift to be observed 

10 by the viewers. This is because any sub-pixel in the 

prominent-color pixel is greatly different from the adjacent 
sub-pixels in luminance. For this reason, to provide a 
high-quality display in units of sub-pixels, the image data needs 
to be filtered so that such prominent color values are smoothed 

15 out. 

[Patent Document 1] : 

WO 00/42762 (page 25, Figs. 11 and 13) 
[Non-Patent Document 1] : 

xx Sub-Pixel Font Rendering Technology'', [online] , 
20 February 20, 2000, Gibson Research Corporation, [retrieved on 
June 19, 2000], Internet <URL: http : //grc . com/cleartype . htm > 
However, when the sub-pixels are smoothedout in luminance, 
the image become dim. This is another problem of image 
deterioration. Here, when a front image is superimposed on a 
25 back image that has been subject to a filtering (smoothing-out ) 
process, the effect of the filtering on the back image is doubled 
at areas where the superimposed front image have high degrees 
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of transparency. Also, the smoothing out of luminance is 
performed each time another front image is superimposed on the 
composite image . 

The more the superimposition of an image or the filtering 
5 is performed on a same image, the more degraded the image quality 
is . This is because the effect of the filtering (smoothing-out ) 
on the image is accumulated and becomes more noticeable with 
the repetition . 

As described above, display apparatuses for displaying 
10 high-quality images in units of sub-pixels have a problem of 
image quality degradation that becomes prominent when sub-pixel 
luminance is smoothed out a plurality of times. 

SUMMARY OF THE INVENTION 

15 The object of the present invention is therefore to provide 

a display apparatus, a display method, and a display program 
that remove the color drifts by smoothing out the luminance of 
the composite image and at the same time preventing the image 
quality from being deteriorated by reducing the amount of 

20 accumulated smooth-out effect, thus achieving high-quality 
images displayed in units of sub-pixels. 

The above object is fulfilled by a display apparatus for 
displaying an image on a display device which includes rows of 
pixels, each pixel composed of three sub-pixels that align in 

25 a lengthwise direction of the pixel rows and emit light of three 
primary colors respectively, the display apparatus comprising: 
a front image storage unit operable to store color values of 
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sub-pixels that constitute a front image to be displayed on the 
display device; a calculation unit operable to calculate a 
dissimilarity level of a target sub-pixel to one or more 
sub-pixels that are adjacent to the target sub-pixel in the 
5 lengthwise direction of the pixel rows, from color values of 
first-target-range sub-pixels composed of the target sub-pixel 
and the one or more adjacent sub-pixels stored in the front image 
storage unit; a superimposing unit operable to generate, from 
color values of the front image stored in the front image storage 

10 unit and color values of an image currently displayed on the 
display device, color values of sub-pixels constituting a 
composite image of the front image and the currently displayed 
image; a filtering unit operable to smooth out color values of 
second-target-range sub-pixels of the composite image that 

15 correspond to the first-target-range sub-pixels, by assigning 
weights, which are determined in accordance with the 
dissimilarity level, to the second-target-range sub-pixels; and 
a displaying unit operable to display the composite image based 
on the color values thereof after the smoothing out. 

20 With the above-stated construction, the display apparatus 

performs the filtering process with a higher degree of smooth-out 
effect on an area in the front image that is different in color 
from adjacent areas to a greater extent in the front image and 
expected to cause a color drift in the composite image to be 

25 observed by the viewer, and performs the filtering process with 
a lower degree of smooth-out effect on an area in the front image 
that is different in color from adjacent areas to a lesser extent 
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and expected to hardly cause a color drift. 

This prevents a color drift from occurring by effectively 
performing a filtering on an area having a prominent color value, 
and at the same time preventing image quality deterioration due 
5 to accumulation of the smooth-out effect, thus providing a 
high-quality image display with the accuracy of sub-pixel. 

In the above display apparatus, the calculation unit may 
calculate a temporary dissimilarity level for each combination 
of the first-target-range sub-pixels, from color values of the 
10 first-target-range sub-pixels, and regards a largest temporary 
dissimilarity level among results of the calculation to be the 
dissimilarity level. 

With the above-stated construction, the display apparatus 
performs the filtering process with a high degree of smooth-out 
15 effect on the target sub-pixel in the composite image even if 
the dissimilarity level of the target sub-pixel to the adjacent 
sub-pixels in the first-target-range sub-pixels is lower than 
a dissimilarity level between sub-pixels other than the target 
sub-pixel in the first-target-range sub-pixels. 
20 This prevents a color drift from occurring due to a drastic 

change in the degree of smooth-out effect provided by the 
filtering process to adjacent sub-pixels. 

In the above display apparatus, the first-target-range 
sub-pixels and the second-target-range sub-pixels may be 
25 identical with each other in number and positions in the display 
device . 

With the above-stated construction, (a) a smooth-out is 
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performed on sub-pixels in the composite image that are identical, 
in number andpositions in the display device, with the sub-pixels 
in the front image from whose color values a dissimilarity level 
is calculated, and (b) the degree of the smooth-out is determined 
5 based on the dissimilarity level. This enables the filtering 
process to be performed accurately. 

This prevents the degree of smooth-out effect by the 
filtering process from drastically changing between adjacent 
sub-pixels . 

10 In the above display apparatus, the filtering unit may 

perform the smoothing out of the second-target-range sub-pixels 
if the dissimilarity level calculated by the calculation unit 
is greater than a predetermined threshold value, and may not 
perform the smoothing out if the calculated dissimilarity level 

15 is no greater than the predetermined threshold value. 

With the above-stated construction, the display apparatus 
performs the filtering process only on such an area as is expected 
to cause a color drift in the composite image. 

This reduces the area on which the filtering is performed 

20 redundantly in the composite image. 

The above object is also fulfilled by a display apparatus 
for displaying an image on a display device which includes rows 
of pixels, each pixel composed of three sub-pixels that align 
in a lengthwise direction of the pixel rows and emit light of 

25 three primary colors respectively, the display apparatus 

comprising: a front image storage unit operable to store color 
values and transparency values of sub-pixels that constitute 
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a front image to be displayed on the display device, where the 
transparency values indicate degrees of transparency of 
sub-pixels of the front image when the front image is superimposed 
on an image currently displayed on the display device; a 
5 calculation unit operable to calculate a dissimilarity level 
of a target sub-pixel to one or more sub-pixels that are adjacent 
to the target sub-pixel in the lengthwise direction of the pixel 
rows, from at least one of (i) color values and (ii) transparency 
values of first-target-range sub-pixels composed of the target 

10 sub-pixel and the one or more adjacent sub-pixels stored in the 
front image storage unit; a superimposing unit operable to 
generate, from color values of the front image stored in the 
front image storage unit and color values of the image currently 
displayed on the display device, color values of sub-pixels 

15 constituting a composite image of the front image and the 

currently displayed image; a filtering unit operable to smooth 
out color values of second-target-range sub-pixels of the 
composite image that correspond to the first-target-range 
sub-pixels, by assigning weights, which are determined in 

20 accordance with the dissimilarity level, to the 

second-target-range sub-pixels; and a displaying unit operable 
to display the composite image based on the color values thereof 
after the smoothing out. 

With the above-stated construction, the display apparatus 

25 performs the filtering process with a higher degree of smooth-out 
effect on an area in the front image that is different in color 
or degree of transparency from adjacent areas to a greater extent 



in the front image and expected to cause a color drift in the 
composite image to be observed by the viewer, and performs the 
filtering process with a lower degree of smooth-out effect on 
an area in the front image that is different in color or degree 
of transparency from adjacent areas to a lesser extent and 
expected to hardly cause a color drift. 

This prevents a color drift from occurring by effectively 
performing a filtering on an area having a prominent color value, 
and at the same time preventing image quality deterioration due 
to accumulation of the smooth-out effect, thus providing a 
high-quality image display with the accuracy of sub-pixel. 

In the above display apparatus, the calculation unit may 
calculate a temporary dissimilarity level for each combination 
of the first-target-range sub-pixels, from at least one of (i) 
color values and (ii) transparency values of the 
first-target-range sub-pixels, and regards a largest temporary 
dissimilarity level among results of the calculation to be the 
dissimilarity level . 

With the above-stated construction, the display apparatus 
performs the filtering process with a high degree of smooth-out 
effect on the target sub-pixel in the composite image even if 
the dissimilarity level of the target sub-pixel to the adjacent 
sub-pixels in the first-target-range sub-pixels is lower than 
a dissimilarity level between sub-pixels other than the target 
sub-pixel in the first-target-range sub-pixels. 

This prevents a color drift from occurring due to a drastic 
change in the degree of smooth-out effect provided by the 
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filtering process to adjacent sub-pixels. 

In the above display apparatus, the first-target-range 
sub-pixels and the second-target-range sub-pixels may be 
identical with each other in number and positions in the display 
5 device. 

With the above-stated construction, the degree of 
smooth-out to be performed on sub-pixels in the composite image 
is determined based on a dissimilarity level that has been 
calculated from color values of sub-pixels in the front image 
10 that are identical, in number andpositions in the display device, 
with the sub-pixels in the composite image on which the smooth-out 
is performed . This enables the filtering process to be performed 
accurately. 

In the above display apparatus, the filtering unit may 
15 perform the smoothing out of the second-target-range sub-pixels 
if the dissimilarity level calculated by the calculation unit 
is greater than a predetermined threshold value, and may not 
perform the smoothing out if the calculated dissimilarity level 
is no greater than the predetermined threshold value. 
20 With the above-stated construction, the display apparatus 

performs the filtering process only on such an area as is expected 
to cause a color drift in the composite image. 

This reduces the area on which the filtering is performed 
redundantly in the composite image. 
25 The above object is also fulfilled by a display method 

for displaying an image on a display device which includes rows 
of pixels, each pixel composed of three sub-pixels that align 
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in a lengthwise direction of the pixel rows and emit light of 
three primary colors respectively, the display method 
comprising: a front image acquiring step for acquiring color 
values of first-target-range sub-pixels composed of a target 
5 sub-pixel and one or more sub-pixels that are adjacent to the 
target sub-pixel in the lengthwise direction of the pixel rows, 
the first-target-range sub-pixels are included in sub-pixels 
that constitute a front image to be displayed on the display 
device; a calculation step for calculating a dissimilarity level 

10 of the target sub-pixel to the one or more sub-pixels, from the 
color values of the first-target-range sub-pixels acquired in 
the front image acquiring step; a superimposing step for 
generating, from the color values of the front image acquired 
in the front image acquiring step and color values of an image 

15 currently displayed on the display device, color values of 
sub-pixels constituting a composite image of the front image 
and the currently displayed image; a filtering step for smoothing 
out color values of second-target-range sub-pixels of the 
composite image that correspond to the first-target-range 

20 sub-pixels, by assigning weights, which are determined in 
accordance with the dissimilarity level, to the 
second-target-range sub-pixels; and a displaying step for 
displaying the composite image based on the color values thereof 
after the smoothing out. 

25 With the above-stated construction, the display apparatus 

performs the filtering process with a higher degree of smooth-out 
effect on an area in the front image that is different in color 
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from adjacent areas to a greater extent in the front image and 
expected to cause a color drift in the composite image to be 
observed by the viewer, and performs the filtering process with 
a lower degree of smooth-out effect on an area in the front image 
5 that is different in color from adjacent areas to a lesser extent 
and expected to hardly cause a color drift. 

This prevents a color drift from occurring by effectively 
performing a filtering on an area having a prominent color value, 
and at the same time preventing image quality deterioration due 

10 to accumulation of the smooth-out effect, thus providing a 
high-quality image display with the accuracy of sub-pixel. 

The above object is also fulfilled by a display method 
for displaying an image on a display device which includes rows 
of pixels, each pixel composed of three sub-pixels that align 

15 in a lengthwise direction of the pixel rows and emit light of 
three primary colors respectively, the display method 
comprising: a front image acquiring step for acquiring color 
values and transparency values of first-target-range sub-pixels 
composed of a target sub-pixel and one or more sub-pixels that 

20 are adjacent to the target sub-pixel in the lengthwise direction 
of the pixel rows , the first-target-range sub-pixels are included 
in sub-pixels that constitute a front image to be displayed on 
the display device, where the transparency values indicate 
degrees of transparency of sub-pixels of the front image when 

25 the front image is superimposed on an image currently displayed 
on the display device; a calculation step for calculating a 
dissimilarity level of the target sub-pixel to the one or more 
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sub-pixels, from at least one of the (i) color values and (ii) 
transparency values of the f irst-target-range sub-pixels 
acquired in the front image acquiring step; a superimposing step 
for generating, from the color values of the front image acquired 
5 in the front image acquiring step and color values of the currently 
displayed image, color values of sub-pixels constituting a 
composite image of the front image and the currently displayed 
image; a filtering step for smoothing out color values of 
second-target-range sub-pixels of the composite image that 

10 . correspond to the first-target-range sub-pixels, by assigning 
weights, which are determined in accordance with the 
dissimilarity level, to the second-target-range sub-pixels ; and 
a displaying step for displaying the composite image based on 
the color values thereof after the smoothing out. 

15 With the above-stated construction, the display apparatus 

performs the filtering process with a higher degree of smooth-out 
effect on an area in the front image that is different in color 
or degree of transparency from adjacent areas to a greater extent 
in the front image and expected to cause a color drift in the 

20 composite image to be observed by the viewer, and performs the 
filtering process with a lower degree of smooth-out effect on 
an area in the front image that is different in color or degree 
of transparency from adjacent areas to a lesser extent and 
expected to hardly cause a color drift. 

25 This prevents a color drift from occurring by effectively 

performing a filtering on an area having a prominent color value, 
and at the same time preventing image quality deterioration due 
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to accumulation of the smooth-out effect, thus providing a 
high-quality image display with the accuracy of sub-pixel. 

The above object is also fulfilled by a display program 
for displaying an image on a display device which includes rows 
of pixels, each pixel composed of three sub-pixels that align 
in a lengthwise direction of the pixel rows and emit light of 
three primary colors respectively, the display program causing 
a computer to execute : a front image acquiring step for acquiring 
color values of first-target-range sub-pixels composed of a 
target sub-pixel and one or more sub-pixels that are adjacent 
to the target sub-pixel in the lengthwise direction of the pixel 
rows, the first-target-range sub-pixels are included in 
sub-pixels that constitute a front image to be displayed on the 
display device; a calculation step for calculating a 
dissimilarity level of the target sub-pixel to the one or more 
sub-pixels, from the color values of the first-target-range 
sub-pixels acquired in the front image acquiring step; a 
superimposing step for generating, from the color values of the 
front image acquired in the front image acquiring step and color 
values of an image currently displayed on the display device, 
color values of sub-pixels constituting a composite image of 
the front image and the currently displayed image; a filtering 
step for smoothing out color values of second-target-range 
sub-pixels of the composite image that correspond to the 
first-target-range sub-pixels, by assigning weights, which are 
determined in accordance with the dissimilarity level, to the 
second-target-range sub-pixels; and a displaying step for 
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displaying the composite image based on the color values thereof 
after the smoothing out. 

With the above-stated construction, the display apparatus 
performs the filtering process with a higher degree of smooth-out 
effect on an area in the front image that is different in color 
from adjacent areas to a greater extent in the front image and 
expected to cause a color drift in the composite image to be 
observed by the viewer, and performs the filtering process with 
a lower degree of smooth-out effect on an area in the front image 
that is different in color from adjacent areas to a lesser extent 
and expected to hardly cause a color drift. 

This prevents a color drift from occurring by effectively 
performing a filtering on an area having a prominent color value, 
and at the same time preventing image quality deterioration due 
to accumulation of the smooth-out effect, thus providing a 
high-quality image display with the accuracy of sub-pixel. 

The above object is also fulfilled by a display program 
for displaying an image on a display device which includes rows 
of pixels, each pixel composed of three sub-pixels that align 
in a lengthwise direction of the pixel rows and emit light of 
three primary colors respectively, the display program causing 
a computer to execute: a front image acquiring step for acquiring 
color values and transparency values of first-target-range 
sub-pixels composed of a target sub-pixel and one or more 
sub-pixels that are adjacent to the target sub-pixel in the 
lengthwise direction of the pixel rows, the first-target-range 
sub-pixels are included in sub-pixels that constitute a front 
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image to be displayed on the display device, where the 
transparency values indicate degrees of transparency of 
sub-pixels of the front image when the front image is superimposed 
on an image currently displayed on the display device; a 
5 calculation step for calculating a dissimilarity level of the 
target sub-pixel to the one or more sub-pixels, from at least 
one of the (i) color values and (ii) transparency values of the 
first-target-range sub-pixels acquired in the front image 
acquiring step; a superimposing step for generating, from the 

10 color values of the front image acquired in the front image 
acquiring step and color values of the currently displayed image, 
color values of sub-pixels constituting a composite image of 
the front image and the currently displayed image; a filtering 
step for smoothing out color values of second-target-range 

15 sub-pixels of the composite image that correspond to the 

first-target-range sub-pixels, by assigning weights, which are 
determined in accordance with the dissimilarity level, to the 
second-target-range sub-pixels; and a displaying step for 
displaying the composite image based on the color values thereof 

20 after the smoothing out. 

With the above-stated construction, the display apparatus 
performs the filtering process with a higher degree of smooth-out 
effect on an area in the front image that is different in color 
or degree of transparency from adjacent areas to a greater extent 

25 in the front image and expected to cause a color drift in the 
composite image to be observed by the viewer, and performs the 
filtering process with a lower degree of smooth-out effect on 
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an area in the front image that is different in color or degree 
of transparency from adjacent areas to a lesser extent and 
expected to hardly cause a color drift. 

This prevents a color drift from occurring by effectively 
5 performing a filtering on an area having a prominent color value, 
and at the same time preventing image quality deterioration due 
to accumulation of the smooth-out effect, thus providing a 
high-quality image display with the accuracy of sub-pixel. 

10 BRIEF DESCRIPTION OF THE DRAWINGS 

These and the other objects, advantages and features of 
the invention will become apparent from the following description 
thereof taken in conjunction with the accompanying drawings which 
illustrate a specific embodiment of the invention. 
15 In the drawings : 

Fig. 1 shows the construction of the display apparatus 
100 in Embodiment 1 of the present invention; 

Fig. 2 shows the data structure of the front texture table 
21 stored in the texture memory 3; 
20 Fig. 3 shows the construction of the 

superimposing/sub-pixel processing unit 35; 

Fig. 4 shows the construction of the front-image change 
detecting unit 42; 

Fig. 5 shows the construction of the filtering unit 45; 
25 Fig . 6 shows the construction of a superimposing/sub-pixel 

processing unit 36 for detecting a change in color in the front 
image using the luminance value and a value; 
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Fig. 7 shows the construction of the front-image change 
detecting unit 46; 

Fig. 8 shows the construction of the filtering necessity 
judging unit 47; 

Fig. 9 is a flowchart showing the operation procedures 
of the display apparatus 100 in Embodiment 1 of the present 
invention; 

Fig. 10 is a flowchart showing the operation procedures 
of the display apparatus 100 in Embodiment 1 of the present 
invention; 

Fig. 11 is a flowchart showing the operation procedures 
of the display apparatus 100 in Embodiment 1 of the present 
invention; 

Fig. 12 shows an example of display images 103 and 104 
respectively displayed on a conventional display apparatus and 
the display apparatus 100 in Embodiment 1 of the present 
invention; 

Fig. 13 shows the construction of the display apparatus 
200 in Embodiment 2 of the present invention; 

Fig. 14 shows the construction of the 
superimposing/sub-pixel processing unit 37; 

Fig . 15 shows the construction of the filtering coefficient 
determining unit 4 9; 

Fig. 16 shows relationships between the dissimilarity 
level and the filtering coefficient; 

Fig. 17 shows the construction of the filtering unit 50; 

and 
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Fig. 18 is a flowchart showing the operation procedures 
of the display apparatus 200 in Embodiment 2 of the present 
invention in generating a composite image and performing a 
filtering process on the composite image. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Some preferred embodiments of the present invention will 
be described with reference to the attached drawings, Figs. 1-18. 
Embodiment 1 
General Outlines 

A display apparatus 100 of Embodiment 1 superimposes a 
front image on a back image that has been subject to a filtering 
process in which the luminance is smoothed out to remove color 
drifts. The display apparatus 100 subjects the composite image 
to a f ilteringprocess in which only limited areas of the composite 
image are filtered, so that overlaps of filtering on the back 
image components of the composite image are prevented. The 
display apparatus 100 then displays the composite image in units 
of sub-pixels. 
Construction 

Fig. 1 shows the construction of the display apparatus 
100 in Embodiment 1 of the present invention. The display 
apparatus 100, intended to display high-quality images by 
displaying the images in units of sub-pixels, includes a display 
device 1, a frame memory 2, a texture memory 3, a CPU 4, and 
a drawing processing unit 5. 

The display device 1 includes a display screen (not 
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illustrated) and a driver (not illustrated) . The display screen 
is composed of a plurality of pixels each of which is an alignment 
of three luminous elements (also referred to as sub-pixels) for 
three primary colors R, G and B (red, green and blue) , where 
the pixels are aligned to f ormaplurality of lines . Hereinafter, 
the lengthwise direction of the lines are referred to as a first 
direction and a direction perpendicular to the first direction 
is referred to as a second direction. In each pixel, the three 
sub-pixels are aligned in the first direction in the order of 
R, G and B. The driver reads detailed information of an image 
to be displayed from the frame memory 2 and displays the image 
on the display screen according to the read image information. 

As described earlier, when images are displayed in units 
of sub-pixels, a pixel having a color greatly different from 
adjacent pixels in the first direction causes a color drift to 
be observed by the viewers. This is because any sub-pixel in 
the prominent-color pixel is greatly different from adjacent 
sub-pixels in luminance. For this reason, to provide a 
high-quality display in units of sub-pixels , the image data needs 
to be filtered so that such prominent luminance values are 
smoothed out. 

In the filtering process in Embodiment 1, each 
luminance-prominent sub-pixel is smoothed out by distributing 
the luminance value of the target sub-pixel to four surrounding 
sub-pixels, or by receiving excess luminance values from the 
surrounding sub-pixels, the four surrounding sub-pixels being 
composed of two sub-pixels before and two sub-pixels after the 
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target sub-pixel in the first direction. 

The frame memory 2 is a semiconductor memory to store 
detailed information of an image to be displayed on the display 
screen. The image information stored in the frame memory 2 
includes color values of the three primary colors R, G and B 
for each pixel constituting the image to be displayed on the 
screen, in correspondence to each pixel constituting the display 
screen . It shouldbe notedhere that the image information stored 
in the frame memory 2 is information of an image that has been 
subject to the filtering process and is ready to be displayed 
on the display screen. 

It should be noted here that in Embodiment 1, each primary 
color R, G or B takes on color values from "0" to "1" inclusive. 
Each combination of color values for three primary colors of 
a pixel represents a color of the pixel. For example, a pixel 
composed of R=l, G=l, B=l is white. Also, a pixel composed of 
R=0, G=0, B=0 is black. 

The texture memory 3 is a memory to store a front texture 
table 21 which includes detailed information of a texture image 
that is mapped onto the front image. The information stored 
in the texture memory 3 includes color values of the sub-pixels 
constituting the texture image. 

Fig. 2 shows the data structure of the front texture table 
21 stored in the texture memory 3. As shown in Fig. 2, the front 
texture table 21 includes a pixel coordinates column 22a, a color 
value column 22b, and an a value column 22c. in the table, each 
row corresponds to a pixel, has respective values of the columns, 
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and is referred to as a piece of pixel information. The front 
texture table 21 includes as many pieces of pixel information 
as the number of pixels constituting the texture images. 

It should be noted here that the pixel coordinates column 
22a includes u and v coordinate values assigned to the pixels 
constituting the texture image. 

Also, in the present document, the a value, which takes 
on values from "0" to "1" inclusive, indicates a degree of 
transparency of a pixel of a front image when the front image 
is superimposed on a back image. More specifically, when the 
a value is "0", the corresponding pixel of the front image becomes 
transparent, and the color values of the corresponding pixel 
in the back image are used as they are in the composite image; 
when the a value is xx l", the corresponding pixel of the front 
image becomes non-transparent, and the color values of the 
front-image pixel are used as they are in the composite image; 
and when the condition 0<a<l is satisfied, weighted averages 
of the pixels of the front andback images are used in the composite 
image . 

The CPU (Central Processing Unit) 4 provides the drawing 
processing unit 5 with apex information. The apex information 
is used when the texture image is mapped onto the front image. 
Each piece of apex information includes (i) display position 
coordinates (x,y) of an apex of a partial triangular area of 
the front image and (ii) texture image pixel coordinates (u,v) 
of a corresponding pixel in the texture image. The display 
position coordinates (x,y) are in a X-Y coordinate system 
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composed of an X axis extending in the first direction and a 
Y axis extending in the second direction. Hereinafter, the 
partial triangular area of the front image indicated by three 
pieces of apex information is referred to as a polygon. 
5 The drawing processing unit 5 reads image information from 

the frame memory 2 and the texture memory 3, and generate images 
to be displayed on the display device 1 . The drawing processing 
unit 5 includes a coordinate scaling unit 31, a DDA unit 32, 
a texture mapping unit 33, a back- image tripling unit 34, and 

10 a superimposing/sub-pixel processing unit 35. 

The coordinate scaling unit 31 converts a series of display 
position coordinates (x,y) contained in the apex information 
into a series of internal processing coordinates (x' , y' ) . The 
internal processing coordinates (x' , y ' ) are in a X' -Y' coordinate 

15 system composed of an X' axis extending in the first direction 
and a Y' axis extending in the second direction. Each sub-pixel 
constituting the display screen is assigned a pair of internal 
processing coordinates (x',y')« More specifically, the 
coordinate conversion is performed using the following 

20 equations . 

x'=3x, y ' =y 

All pixels of the display screen correspond to the 
coordinates (x,y) in the X-Y coordinate system on a one-to-one 
basis, and all sub-pixels of the display screen correspond to 
25 the coordinates (x',y') in the X'-Y' coordinate system on a 
one-to-one basis . Accordingly, each pair of coordinates (x,y) 
corresponds to three pairs of coordinates (x' , y' ) . For example, 
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(x,y) = (0,0) corresponds to (x' , y' ) = (0, 0) , (1,0), (2,0). 

The DDA unit 32, each time it receives from the CPU 4 three 
pieces of apex information corresponding to three apexes of a 
polygon, determines sub-pixels to be included in the polygon 
of the front image using the internal processing coordinates 
(x' , y' ) output from the coordinate scaling unit 31 to indicate 
an apex of the polygon, using the digital differential analysis 
(DDA) . Also, the DDA unit 32 correlates the texture image pixel 
coordinates (u,v) with the internal processing coordinates 
(x' , y' ) for each sub-pixel in the polygon it has determined using 
DDA. 

The texture mapping unit 33 reads, from the front texture 
table 21 stored in the texture memory 3, pieces of pixel 
information for the texture image in correspondence with 
sub-pixels inpolygons constituting the front image as correlated 
by the DDA unit 32, and outputs a color value and an a value 
for each sub-pixel in polygons to the superimposing/sub-pixel 
processing unit 35. The texture mapping unit 33 also outputs 
internal processing coordinates (x' , y' ) of the sub-pixels, for 
each of which a color value and an a value are output to the 
superimposing/sub-pixel processing unit 35, to the back-image 
tripling unit 34 . 

The back-image tripling unit 34 reads, from the display 
image information stored in the frame memory 2, color values 
of the three primary colors R, G and B for each pixel, receives 
internal processing coordinates from the texture mapping unit 
33, and outputs color values of the pixel corresponding to the 
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sub-pixels of the received internal processing coordinates to 
the superimposing/sub-pixel processing unit 35, as the color 
values of the back image at the received internal processing 
coordinates. More specif ically, the back-image tripling unit 
5 34 calculates and assigns three color values for R, G and B to 
each sub-pixel constituting the back image, using the following 
equations . 

Rb(x' , y' )=Rb(x'+l,y' )=Rb(x'+2,y' )=Ro(x,y) , 
Gb (x' , y' )=Gb (x' +1, y' ) =Gb (x' +2, y' ) =Go (x, y) , 

10 Bb (x' , y' ) =Bb (x' +1, y' ) =Bb (x' +2, y' ) =Bo (x, y) , where 

Ro(x,y), Go(x,y) , and Bo(x,y) represent, respectively, color 
values of R, G, and B of a pixel identified by display position 
coordinates (x,y); Rb(x',y'), Gb(x',y')/ and Bb(x',y') 
respectively represent color values of R, G, B of a sub-pixel 

15 identified by coordinates (x',y') f Rb(x'+l,y'), Gb(x'+l,y'), 
and Bb (x' +1, y' ) respectively represent color values of R, G, 
B of a sub-pixel identified by coordinates (x'+l,y'), and 
Rb(x'+2,y')/ Gb(x'+2,y / ), and Bb(x'+2,y') respectively 
represent color values of R, G, B of a sub-pixel identified by 

20 coordinates (x'+2,y') . The sub-pixels identified by internal 
processing coordinates (x' , y' ) , (x'+l,y') f and (x'+2,y') 
correspond to the pixel identified by display position 
coordinates (x, y) , where the relation between the internal 
processing coordinates (x',y') and the display position 

25 coordinates (x, y) is represented by the following equations. 
x=[x'/3], y=y' , where 
[z] represents an integer that is the largest among the integers 
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no smaller than z. 

Fig. 3 shows the construction of the 
superimposing/sub-pixel processing unit 35. The 
superimposing/sub-pixel processing unit 35 generates the color 
values of a composite image to be displayed on the display device 
1, from the color values and the a values of the front image 
and the color values of the back image. The 
superimposing/sub-pixel processing unit 35 includes a 
superimposing unit 41, a front-image change detecting unit 42, 
a filtering necessity judging unit 43, a threshold value storage 
unit 44, and a filtering unit 45. 

The superimposing unit 41 calculates color values of a 
composite image from (a) the color values and a values of the 
front image output from the texture mapping unit 33 and (b) the 
color values of the back image output from the back-image tripling 
unit 34 , and outputs the calculated color values of the composite 
image to the filtering unit 45. More specifically, the color 
values of the composite image are calculated using the following 
equations . 

Ra (x' ,y' )=Rp(x' ,y' ) X a (x' , y' ) +Rb <x' , y' ) X (1- a (x' , y' ) ) , 
Ga (x' , y' ) =Gp (x' , y' ) X a (x' , y' ) +Gb (x' , y' ) X (1- a (x' , y' ) ) , 
Ba(x' ,y' )=Bp(x' ,y' ) X a (x' , y' ) +Bb (x' , y' ) X (1- a (x' , y' ) ) , 
where 

Rp (x' , y' ) , Gp (x' , y' ) , and Bp (x' , y' ) represent color values of 
R, G, and B of the front image at internal processing coordinates 
(x' , y' ) , a (x' , y' ) represents an a value of the front image at 
internal processing coordinates (x' , y' ) , Rb (x' , y' ) , Gb (x' , y' ) , 
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and Bb(x' , y' ) represent color values of R, G, and B of the back 
image at internal processing coordinates (x' , y' ) , andRa (x' , y' ) , 
Ga(x',y'), and Ba (x' , y' ) represent color values of R, G, and 
B of the composite image at internal processing coordinates 
5 <x',y'>. 

In Embodiment 1, both the color values and a values of 
the front image are accurate to sub-pixels . However, to achieve 
the superimposing at each sub-pixel, both types of values are 
not necessarily accurate to sub-pixels, but only one of the color 

10 values or the a values may be accurate to sub-pixels and the 
other may be accurate to pixels. In such a case, the values 
with the accuracy of pixel may be expanded to have the accuracy 
of sub-pixel, as is the case shown in Embodiment 1 where the 
color values of the front image are expanded to the color values 

15 of the back image. 

The a values may be used in different ways in image 
superimposing from the way shown in Embodiment 1, but any method 
will do for achieving the present invention in so far as the 
amounts of back image components in composite images increase 

20 or decrease monotonously in correspondence with a values. 

In Embodiment 1, the a value ranging from "0" to "1" is 
used. However, a parameter indicating a ratio of a front image 
to a back image in a composite image may be used instead. For 
example, a one-bit flag that indicates whether the front image 

25 is transparent ( xx 0") or non-transparent ("1") maybe used. This 
binary information can therefore be used to judge whether the 
filtering process is required or not. In this case, the flag=0 
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corresponds to or=0, and the flag=l corresponds to a =1 . 

Fig. 4 shows the construction of the front-image change 
detecting unit 42. The front-image change detecting unit 42 
calculates a dissimilarity level of a sub-pixel to the 
5 surrounding sub-pixels for each sub-pixel constituting a front 
image, using what is called Euclidean square distance in a color 
space including a values. The front-image change detecting 
unit 42 includes a color value storage unit 51, a color space 
distance calculating unit 52, and a largest color space distance 

10 selecting unit 53. 

The following equation defines a Euclidean square distance 
L between a point (Ri, Gi, B lf a i) and a point (R 2 , G 2 , B 2 , a 
2 ) in a color space including a values. 

L= (R2-R1) 2 + (G2-G1) 2 + (B2-B1) 2 + ( a 2 - a i) 2 

15 The color value storage unit 51 receives the color values 

and a values of the front image from the texture mapping unit 
33 in sequence and stores color values and a values of five 
sub-pixels identified by internal processing coordinates 
(x'-2,y'), (x'-l,y'), (x',y'), (x'+l,y'), (x' +2 , y' ) which align 

20 in the first direction, where the processing target is the 
sub-pixel at internal processing coordinates (x',y'). 

The color space distance calculating unit 52 calculates 
the Euclidean square distance in a color space including a values 
for each combination of the five sub-pixels identified by 

25 internal processing coordinates (x'-2,y f ), (x'-l,y')/ (x',y') f 
(x'+l,y'), (x'+2,y'), and outputs the calculated Euclidean 
square distance values to the largest color space distance 
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selecting unit 53. More specif ically, the color space distance 
calculating unit 52 calculates the Euclidean square distance 
for each combination of the five sub-pixels adjacent to aligned 
in the above-shown order with a sub-pixel at coordinates (x' , y' ) 
at the center, using the following equations. 

Lu= (Rpi-2-Rpi-i) 2 + (Gpi-2-Gpi-i) 2 + (Bpi-2-Bpi-i) 2 + ( a ± - 2 - a i-i) 2 
L 2i = (Rpi-2-Rpi) 2 + (Gpi-2-Gpi) 2 + (Bpi-2-Bpi) 2 + ( a ± - 2 - a ± ) 2 
L 3i = (Rpi-2-RPi+i) 2 + (Gpi-2-Gpi+i) 2 + (Bpi-2-Bpi+i) 2 + ( a ± - 2 - a i+1 ) 2 
L 4i = (Rpi- 2 -Rpi +2 ) 2 + (Gpi- 2 -Gpi +2 ) 2 + (Bpi- 2 -Bp i+2 ) 2 + ( a ± - 2 ~ a i+2 ) 2 
L 5i = (Rpi-i-Rpi) 2 + (Gpi-i-Gpi) 2 + (Bpi-i-Bpi) 2 + ( a a ±) 2 
L 6 i= (Rpi-i-Rpi+i) 2 + (Gpi-i-Gpi+i) 2 + (Bpi-i-Bpi+i) 2 + ( a i_i- a i+ i) 2 
L 7i = (Rpi-i-Rpi+2) 2 + (Gpi-i-Gp i+2 ) 2 + (Bpi-i-Bpi+2) 2 + ( a a i+2 ) 2 
L 8i = (Rpi-Rpi+i) 2 + (Gpi-Gpi+i) 2 + (Bpi-Bpi+i) 2 + ( a ±- a i+ i) 2 
L 9 i= (Rpi-Rp i+2 ) 2 + (Gpi-Gp i+2 ) 2 + (Bpi-Bp i+2 ) 2 + ( a ± - a i+2 ) 2 
Lioi= (Rpi + i-Rpi +2 ) 2 + (Gp i+ i-Gp i+2 ) 2 + (Bp i+ i-Bp i+2 ) 2 + ( a ±+2) 2 , 

where Ln to L i0 i represent Euclidean square distances, Rpi-2 to 
Rp±+2f Gpi-2 to Gpi+2f and Bpi-2 to Bpi+2 respectively represent color 
values of R, G, and B at the corresponding internal processing 
coordinates (x'-2,y'), (x'-l,y'), (x',y'), (x'+l,y')/ 
(x'+2,y'), and a i- 2 to a 1+2 represent a values at the 
corresponding internal processing coordinates (x'-2,y'), 
(x'-l,y'), (x',Y'), (x'+l,y'), (x'+2,y') . 

The largest color space distance selecting unit 53 selects 
the largest value among the Euclidean square distance values 
Ln to Lioi output from the color space distance calculating unit 
52, and outputs the selected value L± to the filtering necessity 
judging unit 43 as a dissimilarity level of the sub-pixel 
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identified by the internal processing coordinates (x',y') to 
the surrounding sub-pixels. 

It should be noted here that the dissimilarity level of 
each target sub-pixel to the surrounding sub-pixels may be 
5 obtained using the Euclidean square distance weighted by a 
values. For example, the following equation may be used for 
the calculation. 

Lii=(Ri- 2 X Ofi-2-Ri-iX a i-i) 2 +(Gi- 2 X ai-2-Gi-iX ai_i) 2 + 
(B ± - 2 X fli-2-Bi-iX ai-i) 2 

10 Also, instead of the Euclidean square distance, the 

Euclidean distance, the Manhattan distance, or the Chebychev 
distance may be used to evaluate the dissimilarity level of a 
sub-pixel, as a numerical value that can be calculated using 
color values and/or a values. 

15 In Embodiment 1, the front-image change detecting unit 

42 selects the largest dissimilarity level value as a value 
indicating a difference in the color value of a sub-pixel from 
the surrounding sub-pixels. However, the smallest similarity 
level value may be selected instead, for the same purpose. 

20 In Embodiment 1, the dissimilarity level of each target 

sub-pixel is calculated in comparison with four surrounding 
sub-pixels that are the two sub-pixels before and the two 
sub-pixels after the target sub-pixel in the first direction. 
However, the dissimilarity level of each target sub-pixel is 

25 calculated in comparison with one ormore surrounding sub-pixels . 
However, it is preferable that the sub-pixels in the internal 
processing coordinate system that are used as comparison objects 
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in calculation of dissimilarity level of a sub-pixel are also 
used as the members with which, in the case the sub-pixel has 
a prominent luminance value compared with the surrounding 
sub-pixels, the sub-pixel is smoothed out (the filtering is 
performed) . This is because it makes the judgment, which will 
be described later, on whether to perform the filtering 
(smooth-out) on the sub-pixel more accurate. 

The filtering necessity judging unit 43 shown in Fig. 3 
reads a threshold value from the threshold value storage unit 
44 , and compares the threshold value with the dissimilarity level 
Li output from the largest color space distance selecting unit 
53. The filtering necessity judging unit 43 outputs "1" or "0" 
to a luminance selection unit 64 as a judgment result value, 
where the judgment result value "1" indicates that the 
dissimilarity level L± is larger than the threshold value, and 
the judgment result value "0" indicates that the dissimilarity 
level Li is no larger than the threshold value. 

The threshold value storage unit 44 stores the threshold 
value used by the filtering necessity judging unit 43. 

In Embodiment 1, a dissimilarity level of each sub-pixel 
of the front image to the surrounding sub-pixels is calculated 
using the Euclidean square distance in a color space including 
a values. However, the dissimilarity level may be calculated 
using only the primary colors R, G and B excluding a values. 
It should be noted however that the exclusion of a values makes 
the judgment on whether to perform the filtering (smooth-out) 
on the sub-pixel less accurate. More specifically, it may be 
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judged that the filtering is not required, while it is required 
in actuality, when a target sub-pixel is hardly different from 
the surrounding sub-pixels in color values of R, G and B of the 
front image, but is greatly dif ferent in the a values, resulting 
in the observance of a color drift . 

Fig. 5 shows the construction of the filtering unit 45. 
The filtering unit 45 performs a filtering only on sub-pixels 
that require the filtering, among sub-pixels constituting the 
composite image, and generates the color values of an image to 
be displayed. The filtering unit 45 includes a color space 
conversion unit 61, a filtering coefficient storage unit 62, 
a luminance filtering unit 63, a luminance selection unit 64, 
and an RGB mapping unit 65. 

The color space conversion unit 61 converts the color 
values of the R-G-B color space received from the superimposing 
unit 41 into values of the luminance, blue-color-difference, 
and red-color-difference of a Y-Cb-Cr color space, outputs the 
luminance values to the luminance filtering unit 63, and outputs 
the blue-color-difference value and the red-color-difference 
values to the RGB mapping unit 65. More specifically, the 
conversion is performed using the following equations. 

Y (x' ,y' ) =0.2 999XRa(x' , y' ) +0 . 587 X Ga (x' , y' ) + 
0.114XBa (x f ,y' ) , 

Cb (x' ,y' ) —0 . 1687XRa (x' , y ' ) -0 . 3313 X Ga (x' , y' ) + 
O.SXBa (x' ,y' ) , 

Cr(x' ,y' )=0.5XRa(x / ,y' ) -0 . 4187 XGa (x' , y' ) - 
0. 0813XBa (x',y'), where 
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Y(x',y'), Cb(x',y')/ and Cr(x' f y') represent the luminance, 
blue-color-difference, and red-color-difference at internal 
processing coordinates (x' , y' ) , respectively. 

The filtering coefficient storage unit 62 stores filtering 
coefficients Ci, C 2 , C 3 , C 4 , and C 5 - More specifically, the 
filtering coefficients Ci, C 2 , C3, C 4 , and C5 are values 1/9, 
2/9, 3/9, 2/9, and 1/9, respectively. 

The luminance filtering unit 63 includes a buffer for 
holding luminance values of five sub-pixels identified by 
internal processing coordinates (x'-2,y') f (x'-l,y'), (x',y'), 
(x'+l,y'), (x'+2,y') which align in the first direction , where 
the processing target is the sub-pixel at internal processing 
coordinates (x',y'), and stores the luminance values of the 
composite image into the buffer in sequence as received from 
the color space conversion unit 61. The luminance filtering 
unit 63 also acquires filtering coefficients from the filtering 
coefficient storage unit 62, performs a filtering process for 
smoothing out the five luminance values stored in the buffer 
using the acquired filtering coefficients, and calculates the 
luminance value of the target sub-pixel at internal processing 
coordinates (x',y'). The luminance filtering unit 63 then 
outputs both luminance values of the target sub-pixel obtained 
before and after the filtering process (pre- and post-filtering 
luminance values) to the luminance selection unit 64. More 
specifically, the luminance filtering unit 63 performs the 
filtering process using the following equation. 

Y oi =Ci X Yi- 2 +C 2 X Yi-a+Ca X Y ± +C 4 X Y i+ i+C 5 X Y i+2 , 
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where Y 0 i represents the luminance of the target sub-pixel at 
internal processing coordinates (x' , y' ) after it has been subject 
to the filtering process, Yi- 2 to Y i+2 respectively represent 
luminance values at the corresponding internal processing 
5 coordinates (x' -2, y' ) , (x' -1, y' ) , (x',y'), (x'+l,y'), 

(x'+2,y'), and Ci to C 5 represent filtering coefficients. 

The luminance selection unit 64 selects, based on a 
judgment result value received from the filtering necessity 
judging unit 43, either of the luminance values of before and 

10 after the f ilteringprocess received from the luminance filtering 
unit 63, and outputs the selected luminance value to the RGB 
mapping unit 65. More specifically, the luminance selection 
unit 64 selects and outputs the luminance value of after the 
filtering process (post-filtering luminance value) if it 

15 receives the judgment result value X> 1" from the filtering 

necessity judging unit 43; and selects and outputs the luminance 
value of before the filtering process (pre-f iltering luminance 
value) if it receives the judgment result value "0" from the 
filtering necessity judging unit 43. 

20 The RGB mapping unit 65 includes buffers respectively for 

holding (a) luminance values of three sub-pixels consecutively 
aligned on the X' axis (in the first direction) of the X'-Y' 
coordinate system composed of internal processing coordinates 
and (b) blue-color-difference values and (c) 

25 red-color-difference values of five sub-pixels consecutively 
aligned on the X' axis of the X'-Y' coordinate system. The RGB 
mapping unit 65 stores, sequentially into the buffers starting 
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with the end of the buffers, luminance values received from the 
luminance selection unit 64 and blue-color-difference values 
and red-color-difference values received from the color space 
conversion unit 61 . Each time it stores three luminance values, 
5 the RGB mapping unit 65 extracts blue-color-difference values 
and red-color-difference values of three consecutive sub-pixels 
on the X' axis from the start of the buffers, and calculates 
a blue-color-difference value and a red-color-difference value 
of a pixel in the display position coordinate system 

10 corresponding to the three sub-pixels. More specifically, the 
RGB mapping unit 65 calculates the blue-color-difference value 
and the red-color-difference value of the pixel in the display 
position coordinate system, each as an average of the three 
sub-pixel values, using the following equations. 

15 Cb_ave(x,y)=(Cb(x' , y' )+Cb<x'+l,y' )+ Cb(x'+2,y' ) ) /3, 

Cr_ave (x, y) = (Cr (x' , y' ) +Cr (x'+l, y' ) + Cr (x' +2, y' ) ) /3, 

where 

Cb_ave(x,y) and Cr_ave(x,y) represent the 

blue-color-difference value and the red-color-difference value 
20 of the pixel in the display position coordinate system, Cb (x' , y' ) 
and Cr (x' , y' ) represent the blue-color-difference value and the 
red-color-difference value of sub-pixels at internal processing 
coordinates (x',y'), Cb(x'+l,y') and Cr(x'+l,y') represent the 
blue-color-difference value and the red-color-difference value 
25 of sub-pixels at internal processing coordinates (x'+l,y'), and 
Cb(x'+2,y') and Cr(x'+2,y') represent the 

blue-color-difference value and the red-color-difference value 
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of sub-pixels at internal processing coordinates (x'+2,y'). 

The RGB mapping unit 65 then calculates the color values 
of the pixel in the display position coordinate system using 
the obtained blue-color-difference value and the 
red-color-difference value of the pixel and using the luminance 
values of the three consecutive sub-pixels stored in the buf f er, 
thus converting the Y-Cb-Cr color space into the R-G-B color 
space. More specifically, the RGB mapping unit 65 calculates 
the color values of the pixel, using the following equations. 

R(x,y)=Y(x' , y' ) +1 . 402 X Cr_ave (x, y) , 

G (x, y) =Y (x' +1, y' ) -0 . 34414 XCb_ave (x, y) - 
0. 71414 XCr_ave(x,y) , 

B (x, y) =Y (x'+2, y' ) +1 . 772 Xcb_ave (x, y) , where 
R(x,y), G(x,y), and B (x, y) represent the color values of the 
pixel in the display position coordinate system. 

The color values obtained here are written over the color 
values of the same pixel stored in the frame memory 2 that were 
read by the back-image tripling unit 34. 

With the above-described construction, the display 
apparatus of the present invention performs the f ilteringprocess 
only on such sub-pixels of the composite image as correspond 
to sub-pixels of the front image having color values greatly 
different from adjacent sub-pixels and being expected to cause 
color drifts to be observed by the viewers. This reduces the 
area of the composite image that overlaps the back image (that 
has been subject to the filtering process once) and is subject 
to the filtering process, thus preventing the back image from 
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being deteriorated . 

In Embodiment 1, the color value and a value are used 
to detect a change in color in the front image. However, not 
limited to these elements, other elements may be used to detect 
5 a change in color. The following is a description of an example 
in which the luminance value and a value are used to detect 
a change in color in the front image. 

Fig. 6 shows the construction of a superimposing/sub-pixel 
processing unit 36 for detecting a change in color in the front 

10 image using the luminance value and a value. The 

superimposing/sub-pixel processing unit 36 differs from the 
superimposing/ sub-pixel processing unit 35 in that a front- image 
change detecting unit 46, a filtering necessity judging unit 
47, and a threshold value storage unit 48 have respectively 

15 replaced the corresponding units 42, 43, and 44. Explanation 
on the other components of the superimposing/sub-pixel 
processing units 36 is omitted here since they operate the same 
as the corresponding components in the superimposing/sub-pixel 
processing units 35 that have the same reference numbers. 

20 Fig. 7 shows the construction of the front-image change 

detecting unit 46. The front-image change detecting unit 4 6 
calculates a dissimilarity level of a sub-pixel to the 
surrounding sub-pixels for each sub-pixel constituting a front 
image, using the luminance values and a values . The front-image 

25 change detecting unit 4 6 includes a luminance calculating unit 
54, a color value storage unit 55, a Y largest distance calculating 
unit 56, and an a largest distance calculating unit 57. 
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The luminance calculating unit 54 calculates a luminance 
value from a color value of the front image read from the texture 
mapping unit 33 , and outputs the calculated luminance value to 
the color value storage unit 55. It should be noted here that 
5 the luminance calculating unit 54 calculates the luminance value 
in the same manner as the color space conversion unit 61 converts 
the R-G-B color space to the Y-Cb-Cr color space. 

The color value storage unit 55 sequentially reads the 
a values and luminance values of the front image respectively 

10 from the texture mapping unit 33 and the luminance calculating 
unit 54, and stores luminance values and a values of five 
sub-pixels identified by internal processing coordinates 
(x'-2,y'), (x'-l,y')r (x',y'), (x'+l,y'), (x' +2 , y' ) which align 
in the first direction, where the processing target is the 

15 sub-pixel at internal processing coordinates (x',y')- 

The Y largest distance calculating unit 56 calculates a 
difference between the largest value and the smallest value among 
the luminance values of the sub-pixels at internal processing 
coordinates (x'-2,y'), (x'-l,y'), (x',y'), (x'+l,y'), 

20 (x'+2,y' ), and outputs the calculated difference value to the 
filtering necessity judging unit 47 as a luminance dissimilarity 
level of the sub-pixel at the internal processing coordinates 
(x',y' ) . 

The a largest distance calculating unit 57 calculates 
25 a difference between the largest value and the smallest value 
among the a values of the sub-pixels at internal processing 
coordinates (x' -2,y' ) , (x' -1, y' ) , (x' , y' ) , (x' +l,y' ) , 
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(x / +2,y')f and outputs the calculated difference value to the 
filtering necessity judging unit 47 as an a value dissimilarity 
level of the sub-pixel at the internal processing coordinates 
(x',y'). 

Fig. 8 shows the construction of the filtering necessity 
judging unit 47. The filtering necessity judging unit 47 
compares the luminance dissimilarity level output from the Y 
largest distance calculating unit 56 with a threshold value, 
and compares the a value dissimilarity level output from the 
a largest distance calculating unit 57 with a threshold value. 
The filtering necessity judging unit 47 includes a luminance 
comparing unit 71, an a value comparing unit 72 , and a logical 
OR unit 73. 

The luminance comparing unit 71 reads a threshold value 
for the luminance dissimilarity level from the threshold value 
storage unit 48, and compares the threshold value with the 
luminance dissimilarity level output from the Y largest distance 
calculating unit 56. The luminance comparing unit 71 outputs 
"1" or "0" to the logical OR unit 73 as a judgment result value, 
where the judgment result value M l" indicates that the luminance 
dissimilarity level is larger than the threshold value, and the 
judgment result value "0" indicates that the luminance 
dissimilarity level is no larger than the threshold value. 

The a value comparing unit 72 reads a threshold value 
for the a value dissimilarity level from the threshold value 
storage unit 48, and compares the threshold value with the 
a value dissimilarity level output from the a largest distance 
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calculating unit 57 . The a value comparing unit 72 outputs "1" 
or "0" to the logical OR unit 73 as a judgment result value, 
where the judgment result value "1" indicates that the a value 
dissimilarity level is larger than the threshold value, and the 
5 judgment result value "0" indicates that the a value 

dissimilarity level is no larger than the threshold value. 

The logical or unit 73 outputs a value "1" to the luminance 
selection unit 64 if at least one of the judgment result values 
received from the luminance comparing unit 71 and the a value 
10 comparing unit 72 is "1", and outputs a value "0" to the luminance 
selection unit 64 if both the received judgment result values 
are "0". 

The threshold value storage unit 48 shown in Fig. 6 stores 
the threshold value for the luminance dissimilarity level and 

15 the threshold value for the a value dissimilarity level . More 
specifically, the threshold value storage unit 48 stores a value 
"1/16" as the threshold value for both values when, as is the 
case with Embodiment 1, each of the luminance value and the a 
value takes on values from "0" to "1" inclusive, that is, when 

20 both values are variables standardized by "1", where the value 
"1/16" has been determined based on the perceptibility to the 
human eye of the change in color. 

It should be noted here however that the threshold values 
for the luminance dissimilarity level and a value dissimilarity 

25 level are not limited to "1/16", but . may be any value between 
"0" and "1" inclusive. 

Also, the threshold values for the luminance dissimilarity 
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level and the a value dissimilarity level may be different from 
each other. 

It should be noted here that the luminance dissimilarity 
level and the a value dissimilarity level may not necessarily 
5 be compared with the threshold values separately. For example, 
the largest value Li among values La to Lioi obtained using the 
following equations may be used as a dissimilarity level that 
has taken both the luminance values and a values into account. 
Lii= I Yi-2-Yj.-i I + I a i- 2 - « i-i I , 
10 L 2i = | Yi-2-Yi | + | a i-2- a ± I , 

L3i= I Yi-2-Yi+i | + | a i-2~ a i+ i | , 
L 4 i= I Yi-2-Y i+ 2 I + | a i- 2 - a i+2 I , 
L 5 i= I Yi-i-Yi I + | a i_i- ail, 
Lei= I Yi-i-Y i+1 I + I a i-i- a i+1 | , 
15 L 7 i= I Yi-i~Y i+ 2 I + I a i-i- a i +2 I , 

Lsi= I Yi-Yi+i I + I ff i- a i+i I , 
L9i= I Yi-Yi+2 I + I a i- a i +2 I , 
Iiioi= I Yi+ 2 -Yi+ 2 I + I a i+ 2 - a i+2 I , where 
I X I represents the absolute value of X. 
20 The use of "luminance" dissimilarity level like the above 

ones in the judgment on the necessity of the filtering process 
effectively reduces the amount of calculation required for the 
calculation of dissimilarity level of a sub-pixel to the 
surrounding sub-pixels to be performed for each sub-pixel. 
25 The luminance used in Embodiment 1 is an element that 

expresses the brightness of a displayed color image accurately. 
However, it is also possible to use element "G" among the primary 
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colors R, G and B though it expresses brightness less accurately 
than the luminance. For example, the luminance, 
blue-color-difference, and red-color-difference of the Y-Cb-Cr 
color space may be represented using values of G, as expressed 
in the following equations. 

Y(x',y')=G(x',y' ) , 

Cb (x' , y' ) =-G (x' , y' ) +B (x' , y' ) , 

Cr (x' ,y' )=R(x' ,y' ) -G(x' , y' ) . 

Also, the Y-Cb-Cr color space may be converted to the R-G-B 
color space using the following equations. 
R(x' ,y' )=Y(x' ,y' )+Cr <x' ,y' ) , 
G(x',y')=Y(x\y'), 
B(x' ,y' )=Y(x' ,y' )+Cb(x' , y' ) . 

With this arrangement, the amount of calculation required 
for the conversion to the Y-Cb-Cr color space is reduced 
effectively. 
Operation 

The operation of the display apparatus 100 will be 
described with reference to Figs. 9-11. 

Figs . 9-11 are flowcharts showing the operation procedures 
of the display apparatus 100 in Embodiment 1. The display 
apparatus 100 updates a display image polygon by polygon, where 
polygons constitute the front image. Here, the operation 
procedures of the display apparatus 100 will be described in 
regard with one of the polygons constituting the front image. 

First, the coordinate scaling unit 31 of the drawing 
processing unit 5 receives the apex information from the CPU 
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4, where the apex information shows correspondence between (a) 
pixel coordinates indicating a position in the display screen 
that corresponds to the apex of a polygon constituting the front 
image that is superimposed on a currently displayed image, and 
5 (b) coordinates of a corresponding pixel in the texture image 
which is mapped onto the front image (SI) . The coordinate scaling 
unit 31 converts the display position coordinates contained in 
the apex information into the internal processing coordinates 
that correspond to sub-pixels of the polygon (S2) . The DDA unit 

10 32 correlates the texture image pixel coordinates, which are 
shown in the front texture table 21 stored in the texture memory 
3, with the internal processing coordinates output from the 
coordinate scaling unit 31, for each sub-pixel in polygons 
constituting the front image, using the digital differential 

15 analysis (DDA) (S3) . 

The following description of the procedures concerns one 
of the sub-pixels constituting the polygon. 

The texture mapping unit 33 reads a piece of pixel 
information and an a value of a texture image pixel that 

20 corresponds to a certain sub-pixel in the front image, and outputs 
the read piece of pixel information and a value to the 
superimposing/sub-pixel processing unit 35 (S4) . In the 
following step, it is judged whether color values of a pixel 
in an image currently displayed on the display screen that 

25 corresponds to the certain sub-pixel in the front image have 
already been read (S5) . If they have already been read ("Yes" 
in step S5) , the back-image tripling unit 34 outputs to the 
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superimposing/sub-pixel processing unit 35 the color values of 
the currently displayed image pixel as the color values of the 
back image that corresponds to the certain sub-pixel in the front 
image (S6) . If the color values of the currently displayed image 
pixel have not been read ( x 'No" instepS5) , the back-image tripling 
unit 34 reads color values of the currently displayed image pixel 
that corresponds to the certain sub-pixel , from the frame memory, 
and outputs the read color values to the superimposing/sub-pixel 
as the color values of the back image (S7) . 

The superimposing unit 41 calculates a color value of the 
certain sub-pixel in a composite image from (a) the color values 
and the a value of the front image output from the texture mapping 
unit 33 and (b) the color values of the back image output from 
the back-image tripling unit 34 (S8) , and outputs the calculated 
color values of the composite image sub-pixel to the color space 
conversion unit 61 of the filtering unit 45. The color space 
conversion unit 61 converts the color values of the R-G-B color 
space received from the superimposing unit 41 into the values 
of the luminance, blue-color-difference, and 

red-color-difference of the Y-Cb-Cr color space, outputs the 
luminance values to the luminance filtering unit 63, and outputs 
the blue-color-difference value and the red-color-difference 
values to the RGB mapping unit 65 (S9) . The luminance filtering 
unit 63 stores the luminance value received from the color space 
conversion unit 61 into the buffer (S10) . The buffer holds 
luminance values of five sub-pixels including the certain 
sub-pixel and four other sub-pixels that are adjacent to the 
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certain sub-pixel in the first direction and have been processed 
prior to the certain sub-pixel. The luminance filtering unit 
63 regards a sub-pixel at the center of the five sub-pixels as 
the target sub-pixel , and calculates the luminance value of the 
5 target sub-pixel by performing a filtering process in accordance 
with the filtering coefficient received from the filtering 
coefficient storage unit 62 (Sll) , and outputs the pre-f iltering 
and post-filtering luminance values of the target sub-pixel to 
the luminance selection unit 64. 

10 The color value storage unit 51 stores the color values 

and a value of the certain sub-pixel in the front image received 
from the texture mapping unit 33 (S12) . As a result of this, 
the color value storage unit 51 currently stores color values 
and a values of five sub-pixels including the certain sub-pixel 

15 and four other sub-pixels that are adjacent to the certain 
sub-pixel in the first direction and have been processed prior 
to the certain sub-pixel. The color space distance calculating 
unit 52 calculates the Euclidean square distance in a color space 
including a values for each combination of the five sub-pixels 

20 identified whose values are stored in the color value storage 
unit 51. The largest color space distance selecting unit 53 
selects the largest value among the Euclidean square distance 
values output from the color space distance calculating unit 
52, and outputs the selected value to the filtering necessity 

25 judging unit 43 as a dissimilarity level of the target sub-pixel 
to the surrounding sub-pixels (S13) . 

The filtering necessity judging unit 43 judges whether 
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the dissimilarity level output from the largest color space 
distance selecting unit 53 is larger than the threshold value 
stored in the threshold value storage unit 44 (S14) . If the 
dissimilarity level is larger than the threshold value ("Yes" 
5 in step S14), the filtering necessity judging unit 43 outputs 
judgment result value "1", which indicates that the filtering 
is necessary, to the luminance selection unit 64 (S15) . If the 
dissimilarity level is no larger than the threshold value ("No" 
in step S14), the filtering necessity judging unit 43 outputs 

10 judgment result value "0", which indicates that the filtering 
is not necessary, to the luminance selection unit 64 (S16) . 

The luminance selection unit 64 j udges whether the j udgment 
result value output by the filtering necessity judging unit 43 
is "1" (SI 7) . If the judgment result value "1" has been output 

15 ("Yes" in step S17) , the luminance selection unit 64 outputs 
the post-filtering luminance value to the RGB mapping unit 65 
(S18) . If the judgment result value "0" has been output ("No" 
in step S17) , the luminance selection unit 64 outputs the 
pre-f iltering luminance value to the RGB mapping unit 65 (S19) . 

20 The steps described so far are repeated by shifting the 

target sub-pixel one at a time in the first direction until the 
luminance values of sub-pixels that correspond to one pixel in 
the display screen are stored in the buffers for storing (a) 
luminance values of three consecutively aligned sub-pixels 

25 output from the luminance selection unit 64 and (b) 

blue-color-difference values and (c) red-color-difference 
values of five consecutively aligned sub-pixels output from the 
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color space conversion unit 61 ("No" in step S20) . Each time 
the luminance values of sub-pixels that correspond to one pixel 
in the display screen are stored in the buffers ("Yes" in step 
S20) , the RGB mapping unit 65 converts the Y-Cb-Cr color space 
5 into the R-G-B color space using the luminance values, the 
blue-color-difference values, and the red-color-difference 
values of the three consecutively aligned sub-pixels, that is, 
calculates the color values of the pixel in the display screen 
that corresponds to the three consecutively aligned sub-pixels 

10 (S21) . The color values obtained here are written over the color 
values of the same pixel stored in the frame memory 2 (S22) . 

The steps described so far are repeated by shifting the 
target sub-pixel one at a time in the first direction until all 
the sub-pixels constituting the polygon that has been correlated 

15 by the DDAunit 32 with the pixel in the texture image are processed 
(S23) . 

The above-described operation procedures are repeated as 
many times as there are polygons constituting the front image. 
With such an operation, the display apparatus of the present 

20 invention performs the filtering process only on such sub-pixels 
of the composite image as correspond to sub-pixels of the front 
image having color values greatly different from adjacent 
sub-pixels andbeing expected to cause color drifts to be observed 
by the viewers. This reduces the area of the composite image 

25 that overlaps the back image (that has been subject to the 
filtering process once) and is subject to the filtering process, 
thus preventing the back image from being deteriorated. 
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Example 

Fig, 12 shows an example of display images displayed on 
a conventional display apparatus and the display apparatus 100 
in Embodiment 1 of the present invention. In Fig. 12, 103 
indicates a display image displayed on a conventional display 
apparatus, and 104 indicates a display image displayed on the 
display apparatus 100 in Embodiment 1. Both display images 103 
and 104 are composite images of a front image 101 and a back 
image 102, where only the back image 102 has been subject to 
the filtering process. The front image 101 includes: a 
non-transparent area 101a shaped like a ring; and transparent 
areas 101b . The back image 102 includes : a non-transparent area 
102a shaped like a triangle; and transparent areas 102b. When 
the front image 101 is superimposed on the back image 102 to 
be displayed by the conventional display apparatus as the 
composite image 103, the whole area of the front image 101 is 
subject to the filtering process. As a result, the filtering 
process is performed twice on an area 103a that is an overlapping 
area of the front image 101 and the back image 102 in the composite 
image . 

In contrast, in the display image 104 displayed by the 
display apparatus 100 in Embodiment 1, the filtering process 
is performed twice only on an area 104c at which an area 104a 
and an area 104b cross each other, the area 104a . corresponding 
to the non-transparent area 101a and the area 104b corresponding 
to the non-transparent area 102a. This is because the display 
apparatus 100 in Embodiment 1 subjects only the non-transparent 
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area 101a in the front image 101 to the filtering process. 

Embodiment 2 
General Outlines 
5 In Embodiment 1, the display apparatus 100 judges on the 

necessity of the filtering process based on the dissimilarity 
level of each sub-pixel to the surrounding sub-pixels in the 
front image so that the area of the composite image that overlaps 
the back image and is subject to the filtering process is limited 

10 to a small area. In Embodiment 2, the display apparatus varies 
the degree of the smooth-out effect provided by the filtering 
process according to the dissimilarity level of each sub-pixel 
to the surrounding sub-pixels in the front image, for a similar 
purpose of reducing the accumulation of the smooth-out effect 

15 to provide a high-quality image display with the accuracy of 
sub-pixel . 
Construction 

Fig. 13 shows the construction of the display apparatus 
200 in Embodiment 2 of the present invention. As shown in Fig. 

20 13, the display apparatus 200 has the same construction as the 
display apparatus 100 except for a superimposing/sub-pixel 
processing unit 37 replacing the superimposing/sub-pixel 
processing unit 35. Explanation on the other components of the 
display apparatus 200 is omitted here since they operate the 

25 same as the corresponding components in the display apparatus 
100 that have the same reference numbers. 

Fig. 14 shows the construction of the 
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superimposing/sub-pixel processing unit 37. The 
superimposing/sub-pixel processing unit 37 differs from the 
superimposing/sub-pixel processing unit 35 in Embodiment 1 in 
that a filtering coefficient determining unit 49 and a filtering 
5 unit 50 have replaced the filtering necessity judging unit 43 
and the filtering unit 45. The following is an explanation of 
the filtering coefficient determining unit 49 and the filtering 
unit 50 having different functions from the replaced units in 
Embodiment 1 . 

10 Fig. 15 shows the construction of the filtering coefficient 

determining unit 49. The filtering coefficient determining 
unit 4 9 determines a filtering coefficient in accordance with 
a dissimilarity level received from the front-image change 
detecting unit 42. The filtering coefficient determining unit 

15 49 includes an initial filtering coefficient storage unit 74 
and a filtering coefficient interpolating unit 75. 

The initial filtering coefficient storage unit 74 stores 
filtering coefficients that are set in correspondence with a 
maximum dissimilarity level of a sub-pixel in the front image. 

20 More specifically, the initial filtering coefficient storage 
unit 74 stores values 1/9, 2/9, 3/9, 2/9, and 1/9 as filtering 
coefficients Ci, C 2 , C3, C 4 , and C5. 

The filtering coefficient interpolating unit 75 
determines a filtering coefficient for internal processing 

25 coordinates (x' , y' ) in accordance with the dissimilarity level 
Li received from the front-image change detecting unit 42, and 
outputs the determined filtering coefficient to a luminance 
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filtering unit 66 of the filtering unit 50. 

It should be noted here that as is the case with Embodiment 
1, it is preferable that the sub-pixels in the internal processing 
coordinate system that are used as comparison objects by the 
front-image change detecting unit 42 in calculation of 
dissimilarity level of a sub-pixel are also used as the members 
with which the sub-pixel is smoothed out (the filtering is 
performed) . This is because it makes the determination of 
filtering coefficients to be assigned to the sub-pixel more 
accurate . 

Fig. 16 shows relationships between the dissimilarity 
level and the filtering coefficient . In Fig. 16, the horizontal 
axis represents the dissimilarity level L'i that is obtained 
by standardizing the dissimilarity level Li by "1". More 
specifically, the dissimilarity level L' i is obtainedby dividing 
the dissimilarity level Li by Lmax which is the maximum value 
of the dissimilarity level Li. The vertical axis in Fig. 16 
represents filtering coefficients Cn, C 2 ±, C 3i , C 4 i, andC 5i . Here, 
the less the difference between each filtering coefficient is, 
the more the effect of the smoothing out. The filtering 
coefficients Cii, C2i, C3i, C^±, and Csi are set so that their sum 
is always "1", and thus the amount of energy of light for each 
of R, G, and B of the whole image does not change before or after 
the filtering (smooth-out) . 

As shown in Fig. 16, when the dissimilarity level L'i is 
greater than "64/1" and no greater than "1", the filtering 
coefficients Cii, C2i, C3i, C$± r and Csi take on the values stored 
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in the initial filtering coefficient storage unit 74, 
respectively; and when the dissimilarity level L'i is no smaller 
than "0" and no greater than vx 64/l", the filtering coefficients 
Cn, C 2i , C3i, C 4 i, and C 5 i take on linear-interpolated values from 
the values stored in the initial filtering coefficient storage 
unit 74 to the values that do not produce any effect of 
smoothing-out (that is, values "0", "0", "1", "0", and "0" as 
filtering coefficients C lf C 2 , C 3 , C 4 , and C 5 ) 

More specifically, the filtering coefficients Cn, C 2i , 
C31/ C4i, and Csi at internal processing coordinates (x' , y' ) are 
obtained using the following equations. 

A) For L'i ^ 1/64: 

Cn=l/9, 
C 2i =2/9, 
C 3i =3/9, 
C 4i =2/9, 
C 5i =l/9. 

B) For L'i < 1/64: 

Cii=L'iX64/9, 

C 2i =L'iXl28/9, 

C 3 i=l-L'iX384/9, 

C 4i =L'iXl28/9, 

C 5i =L'iX64/9. 

It should be noted here that any relationships between 
the dissimilarity level and the filtering coefficient may be 
used, not limited to those shown in Fig. 16. For example, the 
sum of the filtering coefficients Cii, C 2 i, C3i, C 4 i, and Csi inay 
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be set to a value other than "1" so that the display image has 
a certain visual effect. 

Also, the filtering coefficients stored in the initial 
filtering coefficient storage unit 74 may be values other than 
1/9, 2/9, 3/9, 2/9, and 1/9. 

Fig. 17 shows the construction of the filtering unit 50. 
The filtering unit 50 differs from the filtering unit 45 in 
Embodiment 1 in that it omits the filtering coefficient storage 
unit 62 and has a luminance filtering unit 66 replacing the 
luminance filtering unit 63 . With this construction, filtering 
coefficients output from the filtering coefficient 
interpolating unit 75 are used instead of the filtering 
coefficients stored in the filtering coefficient storage unit 
62. The following is a description of the luminance filtering 
unit 66 that operates differently from the luminance filtering 
unit 63 in Embodiment 1 . 

The luminance filtering unit 66 includes a buffer for 
holding luminance values of five sub-pixels identified by 
internal processing coordinates (x'-2,y' ), (x'-l,y')r (x',y')/ 
(x'+l,y'), (x'+2,y') which align in the first direction, where 
the processing target is the sub-pixel at internal processing 
coordinates (x',y'), and stores the luminance values of the 
composite image into the buffer in sequence as received from 
the color space conversion unit 61. The luminance filtering 
unit 66 also performs a filtering process for smoothing out the 
five luminance values stored in the buffer using the filtering 
coefficients output from the filtering coefficient 
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interpolating unit 75, and calculates the luminance value of 
the target sub-pixel at internal processing coordinates (x' ,y') . 
The luminance filtering unit 66 then outputs the post-filtering 
luminance value of the target sub-pixel to the RGB mapping unit 
65. It should be noted here that both the luminance filtering 
units 63 and 66 perform the same filtering process. 

In Embodiment 2, the color value and a value are used 
to detect a change in color in the front image. However, as 
is the case with Embodiment 1, other elements relating to visual 
characteristics such as color may be used to detect a change 
in color. 

With the above-described construction of Embodiment 2, 
the display apparatus varies the degree of smooth-out effect 
by the filtering process according to the dissimilarity level 
of each sub-pixel to the surrounding sub-pixels in the front 
image. In contrast to a conventional technique that performs 
a filtering process to provide a constant degree of smooth-out 
effect to each sub-pixel of a composite image, the present 
embodiment provides a -higher degree of smooth-out effect to a 
sub-pixel in a composite image that corresponds to a sub-pixel 
in a front image which is greatly different from surrounding 
sub-pixels in color value, and at the same time prevents a 
sub-pixel in a composite image that corresponds to a sub-pixel 
in a front image which is not so much different from surrounding 
sub-pixels in color value, from being excessively smoothed out. 
Furthermore, the present technique reduces the accumulation of 
the smooth-out effect in the back image component of the composite 
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image . 
Operation 

The operation of the display apparatus 200 will be 
described with reference to Fig. 18 in terms of operations 
5 procedures unique to the display apparatus 200, that is to say, 
from after the superimposing/sub-pixel processing unit 37 
receives the color values and a value of the front image and 
the color values of the back image until the luminance filtering 
unit 66 outputs the luminance values to the RGB mapping unit 
10 65. 

Fig. 18 is a flowchart showing the operation procedures 
of the display apparatus 200 in Embodiment 2 for generating a 
composite image and performing a filtering process on the color 
values . 

15 The color value storage unit 51 stores the color values 

and a value of the certain sub-pixel in the front image received 
from the texture mapping unit 33 (S31) . As a result of this, 
the color value storage unit 51 currently stores color values 
and a values of five sub-pixels including the certain sub-pixel 

20 and four other sub-pixels that are adjacent to the certain 
sub-pixel in the first direction and have been processed prior 
to the certain sub-pixel. The color space distance calculating 
unit 52 calculates the Euclidean square distance in a color space 
including a values for each combination of the five sub-pixels 

25 identified whose values are stored in the color value storage 
unit 51. The largest color space distance selecting unit 53 
selects the largest value among the Euclidean square distance 
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values output from the color space distance calculating unit 
52, and outputs the selected value to the filtering coefficient 
interpolating unit 75 (S32) . 

The filtering coefficient interpolating unit 75 
5 determines a filtering coefficient for the target sub-pixel by 
performing a calculation on the initial values stored in the 
initial filtering coefficient storage unit 74 in accordance with 
the dissimilarity level received from the largest color space 
distance selecting unit 53, and outputs the determined filtering 

10 coefficient to a luminance filtering unit 66 of the filtering 
unit 50 (S33) . 

On the other hand, the superimposing unit 41 calculates 
a color value of the certain sub-pixel in a composite image from 
(a) the color values and the a value of the front image output 

15 from the texture mapping unit 33 and (b) the color values of 
the back image output from the back- image tripling unit 34 (S34) , 
and outputs the calculated color values of the composite image 
sub-pixel to the color space conversion unit 61 of the filtering 
unit 50. 

20 The color space conversion unit 61 converts the color 

values of the R-G-B color space received from the superimposing 
unit 41 into the values of the luminance, blue-color-difference, 
and red-color-difference of the Y-Cb-Cr color space, outputs 
the luminance values to the luminance filtering unit 66, and 

25 outputs the blue-color-difference value and the 

red-color-difference values to the RGB mapping unit 65 (S35) . 

The luminance filtering unit 66 stores the luminance value 
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received from the color space conversion unit 61 into the buffer 
(S36) . The buffer holds luminance values of five sub-pixels 
including the certain sub-pixel and four other sub-pixels that 
are adjacent to the certain sub-pixel in the first direction 
and have been processed prior to the certain sub-pixel. The 
luminance filtering unit 66 regards a sub-pixel at the center 
of the five sub-pixels as the target sub-pixel, and calculates 
the luminance value of the target sub-pixel by performing a 
filtering process in accordance with the filtering coefficient 
received from the filtering coefficient interpolating unit 75, 
and outputs the post-filtering luminance values of the target 
sub-pixel to the RGB mapping unit 65 (S37) . 

With the above-described operation, it is possible to 
reduce the accumulation of the smooth-out effect in the back 
image component of the composite image. 

Not limited to Embodiments 1 and 2 described so far, the 
present invention can be applied to the following cases. 

(1) The operation procedures of each component of the display 
20 apparatus explained in Embodiment 1 or 2 may be written into 

a computer program so as to be executed by a computer. Also, 
the computer program may be recorded in a record medium, such 
as a floppy disk, hard disk, IC card, optical disc, CD-ROM, DVD, 
or DVD-ROM, so that it can be distributed. Also, the computer 
25 program may be distributed via any communication paths. 

(2) In Embodiments 1 and 2, both the front and back images are 
color images in the R-G-B format . However, the present invention 
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can be applied to gray-scale images or color images in the Y-Cb-Cr 
format, as well. 

(3) In both Embodiments 1 and 2, the filtering process is 
performed on the luminance component (Y) of the Y-Cb-Cr color 
5 space converted from the R-G-B color space . However, the present 
invention can be applied to the case where the filtering process 
is performed on each color (R, G, B) of the R-G-B color space, 
or to the case where the filtering process is performed on Cb 
or Cr of the Y-Cb-Cr color space. 

10 (4) The filtering coefficients may be set to other values than 
1/9, 2/9, 3/9, 2/9, and 1/9 which are disclosed in "Sub-Pixel 
Font Rendering Technology". For example, a different filtering 
coefficient may be assigned to each color (R, G, B) of the luminous 
elements corresponding to the sub-pixels to be subject to the 

15 filtering process , in accordance with the degree of contribution 
of each color (R, G, B) to the luminance. 

(5) The data stored in the buffers included in the components 
of Embodiments 1 and 2 may be stored in other places such as 
a partial area of a memory. 
20 (6) The present invention may be achieved as any combinations 
of Embodiments 1 and 2 and the above cases (1) to (5) . 

Although the present invention has been fully described 
by way of examples with reference to the accompanying drawings, 
25 it is to be noted that various changes and modifications will 
be apparent to those skilled in the art. Therefore, unless such 
changes and modifications depart from the scope of the present 
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invention, they should be construed as being included therein. 
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